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This  is  the  final  report  on  Contract  AFOSR-83-0228,  which  funded  our  research  on 
statistical  signal  processing  for  a  period  of  three  years,  between  July  1,  1983  and  June 
30,  1986.  Section  II  provides  a  description  of  work  done  in  the  period  1983-1985  and 
Section  III  describes  recent  results,  obtained  in  1985-1986. 


I.  Introduction 

The  primary  objective  of  our  research  is  to  develop  efficient  and  numerically 
stable  algorithms  for  nonstationary  signal  processing  problems  by  understanding  and 
exploiting  special  structures,  both  deterministic  and  stochastic,  in  the  problems.  We 
also  strive  to  establish  and  broaden  links  with  related  disciplines,  such  as  cascade  filter 
synthesis,  scattering  theory,  numerical  linear  algebra,  and  mathematical  operator  theory 
for  the  purpose  of  cross  fertilization  of  ideas  and  techniques.  These  explorations  have 
led  to  new  results  both  in  estimation  theory  and  in  these  other  fields,  e.g.,  to  new 
orthogonal  cascade  digital  filter  structures,  new  algorithms  for  triangular  and  QR 
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factorization  of  structured  matrices  and  new  techniques  for  stability  testing. 

For  several  years,  the  guiding  principle  in  these  studies  has  been  the  concept  of 
(Toeplitz-oriented)  displacement  structure  (Kailath,  Kung  and  Morf,  (1979)),  which 
generalized  and  subsumed  our  earlier  work  on  fast  (Chandrasekhar)  control  and 
estimation  algorithms  for  state-space  models  (Morf,  Sidhu  and  Kailath,  (1974)). 
Several  authors  have  since  picked  up  these  ideas  in  a  number  of  fields.  A  notable 
such  work  is  a  recent  book  by  Heinig  and  K.  Rost  of  East  Germany,  entitled 
*  Algebraic  Methods  for  Toeplitz-Like  Matrices  and  Operators.*  A  contribution  of 

if.. 

i 

this  book  is  the  introduction  of  a  number  of  different  displacement  rank  concepts  for 
not  only  Toepiitz-like  operators  but  also  Hankel-like,  Vandermonde  and  Hilbert 
operators.  Somewhat  contemporaneously,  in  the  Ph.D.  research  of  H.  Lev-Ari  (parts 
of  which  were  summarized  in  our  AFOSR  proposal  submitted  March  1983),  we 
introduced  a  generating  function  characterization  that  also  lends  itself  to  generalization 
to  a  large  class  of  structured  matrices.  Moreover,  as  we  shall  briefly  describe  below, 
this  approach  introduces  a  natural  geometric  significance  to  the  theory,  which  allows  a 
number  of  other  interesting  developments,  e.g.,  studies  of  various  problems  in  system 
theory,  such  as  minimal  realization,  Pad6  approximation,  control  design,  and  a  variety 
of  root  distribution  (stability)  problems  for  polynomials.  Also,  connections  of  the 
generating  function  approach  to  the  theory  of  inverse  scattering  were  clarified  during 
this  research,  yielding  useful  generalizations  and  a  unified  framework  for  the  derivation 
of  algorithmic  alternatives  for  the  solution  of  the  above-mentioned  problems. 

In  particular,  the  topic  of  root  distribution  problems  for  polynomials  has  led  our 
enquiries  in  a  somewhat  different  direction.  We  started  with  some  recent  results  of  Y. 
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Bistritz  ( Proc .  IEEE ,  September  1984),  in  which  he  obtains  several  new  tests  for  the  ( 

root  distribution  of  polynomials  with  respect  to  the  unit  circle  that  needed  only  half  the  j 

number  of  multiplications  (and  the  same  number  of  additions)  as  the  well  known  j 

Schur-Cohn  (or  equivalently  the  Jury-Marden  table)  test  (Jury,  (1964)).  Now 

estimation  theorists  have  long  known  that  the  Schur-Cohn  test  is  essentially  a  reverse  1 

(degree-reducing)  form  of  the  fast  Levinson  algorithm  for  solving  Toeplitz  linear 

equations.  It  is  therefore  reasonable  to  expect  that  similar  reductions  in  computational 

complexity  could  also  be  obtained  for  the  Levinson  algorithm  itself,  and  this 

possibility  has  now  been  explored  in  some  detail.  In  particular,  we  have  developed 

three  classes  of  reduced  complexity  Levinson-type  algorithms  and  have  demonstrated 

the  relationship  between  them  (Bistritz,  Lev-Ari  and  Kailath,  (1986)).  Moreover,  we 

have  shown  that  these  algorithms  are  essentially  the  only  ones  providing  such 

complexity  reduction.  An  interesting  fact  is  that  the  saving  is  achieved  by  using 

three-term  (rather  than  two-term)  recursions  and  propagating  them  in  an 

Impedance! Admittance  domain  rather  than  the  conventional  scattering  domain.  Our 

results  apply  both  to  Toeplitz  and  to  close  to  Toeplitz  systems.  Moreover  they  provide 

a  general  method  for  reducing  computational  requirements  in  various  recursive 

algorithms,  e.g.  adaptive  least-square  lattice  algorithms.  Bistritz  is  a  postdoctoral 

scholar  at  Stanford,  and  these  results  and  several  related  ones  were  developed  with 

him. 

The  QR  factorization  of  a  matrix  A  is  closely  connected  with  the  triangular 
factorization  of  A*A.  Recently  we  have  shown  that  the  displacement  rank  of  a 
product  of  two  matrices  does  not  exceed  the  sum  of  the  displacement  ranks  of  the 
individual  matrices.  This  result  made  it  possible  to  develop  a  fast  algorithm  for  QR 
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factorization  of  matrices  with  a  displacement  structure,  and  in  particular  for  Toeplitz 
matrices  (Chun,  Kailath  and  Lev-Ari,  (1986)). 
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II.  Exploiting  Generalized  Displacement  Structure 

We  originally  started  (in  the  late  seventies)  with  the  following  definition.  A 
symmetric  matrix  R  has  a  displacement  structure  if  the  difference 

JR  :=  R  -  ZRZ*  .  Z  =  [5j^0 

has  low  rank.  Note  that  Z  is  the  lower  shift  matrix  with  ones  on  the  first 
subdiagonal  and  zeros  everywhere  else.  This  definition  was  motivated  by  the  fact  that 
for  both  Toeplitz  matrices  and  for  inverses  of  Toeplitz  matrices  the  displacement  rank 
(i.e.,  the  rank  of  JR)  is  2.  We  have  shown  in  previous  work  (largely  supported  by 
AFOSR)  that  the  displacement  concept  was  a  key  tool  for  developing  fast  algorithms 
of  many  kinds,  including  factorization  and  inversion  of  Toeplitz  and  near-Toeplitz 
matrices,  and  to  fast  (generalized  Levinson  and  Schur)  algorithms  for  solving  linear 
systems  with  such  coefficient  matrices.  Not  surprisingly,  these  results  led  naturally  to 
cascade  orthogonal  structures  for  the  prediction  of  nonstationary  processes  (Lev-Ari 
and  Kailath,  (1984)).  We  have  also  found  that  the  same  concept  is  tightly  connected 
to  the  more  general  problem  of  cascade  filter  synthesis  in  network  theory  and  digital 
filtering  as  well  as  to  a  variety  of  inverse  scattering  problems  (some  references  are  Rao 
and  Kailath,  (1984,  1985),  Bruckstein  and  Kailath  (1986)). 

Recently  we  have  extended  the  concept  of  displacement  structure  to  a  very  broad 
family  of  structured  matrices,  including  Hankel  matrices  and  their  inverses,  sums  of 
Toeplitz  and  Hankel  matrices  and  several  others  (Lev-Ari  and  Kailath,  (1986)).  The 
generalized  displacement  of  a  matrix  R,  is  defined  as 

VdR  :=  £  4uZ*R(Z7  .  (la) 

*,/= o 
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where  the  asterisk  (*)  denotes  Hermitian  transpose  (complex  conjugate  for  scalars).  J 

I 

This  is  characterized  by  a  (Hermitian)  displacement  matrix  Jd,  j 


Jd  :=  {du\  0  ZkjZN} 


(lb) 


The  previous  notion  of  displacement  corresponds  to  the  particular  displacement  matrix 

'l  0 

3d=  \  Ji 

10  -1 


while  the  displacement  notion  used  by  Heinig  and  Rost  (1984)  for  Hankel  matrices, 
corresponds  to  the  displacement  matrix 


We  have  shown  that  efficient  triangular  factorization  of  a  Hermitian  matrix  R  can  be 
formulated  for  all  displacement  matrices  whose  inertia  is  (1,1).  This  means  that  Jd 
must  have  the  form 


Jd  -  A 


1  0 
IP  -1J 


(2) 


where  A  is  any  matrix  with  two  columns  of  arbitrary  lengths. 

The  concept  of  displacement  structure  and  its  properties  are  more  conveniently 
described  in  terms  of  generating  functions.  The  generating  function  of  a  matrix  R  is 
a  power  series  in  two  complex  variables,  viz., 

/?(z,w)  :=  [1  z  z2  ...]R[1  w  w2  ...]*  (3) 


The  displacement  VdR  of  a  matrix  has  the  generating  function  d(z,w)R(z,w),  where 
/(z,h)  is  the  generating  function  of  the  Hermitian  matrix  3d,  viz.. 
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d(z,w)  =  £  duJ{w*)1  (4) 

kj=o 

Thus  the  generating  function  of  a  Hermitian  matrix  with  a  displacement  structure  has 


the  form 


R(z,w)  = 


G(z)  J  G\w) 

d(z,w) 


where  J  is  any  constant  nonsingular  Hermitian  matrix.  The  triple  {d(z,w),G(z)J}  is 
called  a  generator  of  R(z,w). 

We  have  shown  (Lev-Ari  and  Kailath,  (1986))  that  efficient  triangular 
factorization  of  R  is  possible  if  there  exists  a  matrix  function  0(z)  that  satisfies  the 
matrix  equation 

@(z\J@*(w)  =J-  ■  d^-~  JMJ  (6a) 

d(z,0)d(0,w) 

where 

M  :=  G*(0)R~\0,0)G(0)  =  M*  (6b) 

We  have  also  shown  that  (6)  has  a  solution  if,  and  only  if, 

d(z,w)  =  A  (z)JtA*(w)  (7) 

which  is  the  generating  function  version  of  (2).  The  (nonunique)  solution  of  (6)  is 


0(z)  =\l - jm  .  u 

d(z,0)d(0,x) 


where  U  is  any  constant  matrix  such  that 


UJU  =  J 


and  t  is  any  complex  constant  such  that 
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d(x,x)  =  0  (8c) 

The  factorization  of  R  is  obtained  via  the  recursion 

Gi+1(z)  =  G,(z)0,(z)  ;  =  0,1,2,...  (9) 

where  @,(z)  have  the  form  (8).  This  algorithm  requires  0(n2)  computations  to 
factor  a  structured  nxn  matrix,  in  contrast  to  the  conventional  LDL*  algorithm 
which  requires  G(n3)  operations  to  factor  an  arbitrary  matrix. 

The  generalization  of  the  displacement  concept  has  opened  several  new  avenues 
of  research,  which  we  are  currently  pursuing.  We  have  found  that  a  family  of  so- 
called  Bezoutian  matrices  arising  in  the  theory  of  resultants  of  polynomials,  with 
applications  to  topics  such  as  testing  for  coprimeness,  root  distribution,  compensator 
design,  etc.,  also  has  a  displacement  structure.  Moreover,  this  connection  has 
suggested  a  new  geometric  interpretation  for  the  displacement  function  d(z,w).  Since 
d(z,z)  is  real  for  all  z,  we  can  define  a  partition  of  the  complex  plane  into  three 
mutually  exclusive  sets,  viz., 

£2+  =  (z  ;  d(z,z)  >  0} 

Q0:={z;  d(z,z)  =  0}  (10) 

:=  (z  ;  d(z,z)  <  0} 

Notice  that  the  curve  Q0  is  the  boundary  of  the  domains  Q+,  £2_.  While  the  original 
displacement  concept  turns  out  to  be  associated  with  the  unit  circle  T,  and  the  Hankel 
displacement  is  associated  with  the  real  line  R,  other  curves  may  also  be  considered. 
This  observation  has  also  revealed  a  surprising  connection  with  the  theory  of 
orthogonal  polynomials  on  arbitrary  plane  curves. 
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On  the  fundamental  theoretical  level  we  made  connections  with  the  work  of  L. 
De  Branges,  H.  Dym  and  P.  Dewilde  on  reproducing  kernel  Hilbert  spaces  associated 
with  plane  curves.  The  link  connecting  this  topic  with  the  work  of  Soviet 
mathematicians  (Livsic,  Brodskii,  Krein,  Potapov)  on  operator  colligations  and  J- 
unitary  operators  appears  to  be  the  concept  of  systems  (operators)  that  are  ./-lossless 
with  request  to  a  curve.  This  concept  underlies  our  work  on  factorization  and  cascade 
filter  synthesis,  as  well  as  the  very  recent  work  of  Prabhakara-Rao  and  Dewilde  (1984) 
on  state  space  models  for  such  systems.  In  fact,  our  equation  (6)  implies  that  ©(z)  is 
/-lossless,  i.e., 

0(z)/0*(z)  <  /  z  e  Q+ 

0(z)/@*(z)  =  /  z  6  Q0  (11) 

0(z)/0*(z)  >  /  z  e 


It  is  interesting  to  notice  that  Prabhakara-Rao  and  Dewilde  start  with  (11)  and  show 
that  any  finite-state  solution  of  (11)  must  essentially  have  the  form  (8). 
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Ill  Recent  Results 


Immitance-Domain  Three-Term  Recursions 

The  structured  generating  function  A’  c.-m  is  riot  attested  ■'  we  re; 
generator  {t/lr.w  i.  (7(z»,  J\  with  the  equivalent  ger.cruf-  >r  '-l.  < ,  :  I  !  / 

u here  7  is  an  arbitrary  nonsingular  constant  matrix  We  ma>  there!'  -re  r  * 

to  minimize  the  computational  requirements  of  our  fast  fu^ton/amu  p-' «  ed  ■ 
particular,  we  have  observed  that  when  Jc,.i  i  -  1  -  zw*  ue  when  Lz  o  me 
circle),  then,  the  choice 

'l  1  ' 

T  = 

ll  1. 

results  in  a  5( >'/  reduction  in  the  number  of  multiplications  involved  in  the  pro.  r  : 
We  used  this  observation  to  transform  the  Iwvinson  algor.thm  for  ‘loeplitz  and 
Toephtz  matrices,  v  iz  . 


r  " 

r 

r  -S 

i  -K 

r  s 

:  0 

“n  ’ 1:1 

1 

-kn  i 

L  n  J 

0  L 

S  t:> 

with  initial  conditions. 


-  1  ,  />,,(-)  -  p 

into  a  computationally-improved  recursion,  viz  . 


> 

\'n 

1  kn  0 

-1  r-  r 

-  n 

(Z) 

i 

0  1+A, 

s  4 

T  1  z-  1. 

l-'- 

f0(z)  =  y0(  1+P>  >  g„(r)  =  »./,.( 1  pi 
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\i'  the  polynomials  {/„(:•!.£„(:)}  which  are  obtained  from  {an(z),bn(z)}  via 


-A  *rrr..i! ■< -n 


=  v.  (!  2 


lj  bjz)  ’  V"*° 


a  s.n table  scaling  factor. 


-tt.pansor,  o 


t  (14)  with  { 1 5 j  shows  that  while  the  number  of  multiplications 


•  ’  vj:  reduced  bv  the  transformation  (13),  the  number  of  additions  has,  in  fact, 

•  .  It  tarns  out  that  the  increase  in  the  number  of  additions  can  be  avoided  by 

•  .. e:"  -he  f"o  irrm  recursion  (15),  which  involves  both  fn(z)  and  gn(z)  into  a 

recursion  involving  only  one  of  these  the  polynomials.  The  three-term 
t  f  •:  has  the  form 

VO  -  ^(l-^iJ  .  (17) 

VnU-*n)  [  Vn-1  J 

•*.  •  ..  Mtt.i’.ur  recursion  for  gn(z). 

A  suitable  choice  of  the  scaling  factors  V| /„  leaves  only  one  nontrivial  coefficient 
m  this  recursion.  Since  this  can  be  done  only  in  three  ways,  there  are  three 
vomputationalU  efficient  forms  of  the  recursion  (17),  namely. 


/„. |(’>  =  8„^'+1)/a(r)  -  zf^iz)  , 


In.  l(-)  =  U+\)fn{z)  -  , 


=  ('WnOO  -  zfn- \(z) 


The  conventional  formulation  of  the  Levinson  recursion  (14)  can  be  related  to 


transmission-line  models  (see,  e.g.,  Kailath  and  Lev-Ari,  (1984)  and  Bruckstein  and 
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Kailath  (SIAM  Review,  accepted,  1986/7)).  In  particular,  the  ratio  bn(z)/an(z)  can  be 
interpreted  as  the  scattering  function  of  a  transmission  line  consisting  of  a  cascade  of 
(uniform)  sections  with  different  characteristic  impedances.  On  the  other  hand  the 
ratio  gn{z)lfn{z)  can  be  interpreted  as  the  impedance  (or  admittance)  function  of  the 
same  transmission  line.  For  this  reason  we  shall  say  that  the  original  recursion  (i4)  is 
expressed  in  the  scattering  domain,  whereas  the  transformed  recursions  (15)  or  (17) 
are  expressed  in  the  immitance  domain /  We  first  derived  immitance  domain 
algorithms  as  inverse  scattering  procedures  for  discrete  transmission-line  models  in 
Bruckstein  and  Kailath,  SIAM  Review,  1986/7,  however  we  were  not  interested  there 
in  computational  complexity  issues  and  did  not  recognize  the  reduction  in  operation 
counts. 

The  immitance-domain  version  of  the  Levinson  algorithm  is  also  useful  in  the 
efficient  solution  of  problems  involving  the  so-called  singular  predictor  polynomials 
(Delsarte,  Genin,  Kamp  and  Van  Dooren,  (1982)),  such  as  Pisarenko’s  harmonic 
retrieval  technique. 

Bezoutians 


Bezoutians  are  structured  matrices  B  whose  generating  function  has  the  form 


B(z,w)  = 


7(2)f<7#(w)l*  -  q(z)\p*(w)\* 

[1  4/aU 


where  ln{Jd}  =  { 1,1},  p(z),q(z)  are  arbitrary  complex  polynomials,  and  the  sharp 

(#)  denotes  a  suitably  defined  polynomial  transformation  that  reflects  the  zeros  of  a 
polynomial  with  respect  to  the  circle  Q0  defined  by  d(z,\v)  =  [  1  z]Jd [1  h|*.  In 


f  Bode  (1945)  coined  the  term  im/mlanct  to  denote  both  impedance  and  admittance 


work  in  progress,  we  have  shown  that  the  square  matrix  B  whose  size  equals 
ma x{deg  p,deg  q }  has  a  rank  deficiency  equal  to  the  degree  of  the  greatest  common 
divisor  (divisor)  of  p(z)q(z),  and  that  our  factorization  procedure  efficiently  computes 
this  gcd.  Moreover,  since  J j  can  be  selected  in  many  ways,  we  have  a  large  variety 
of  procedures  at  our  disposal,  with  different  computational  requirements  and  numerical 
behavior.  In  addition,  we  can  apply  equivalence  transformations  of  the  form 
[p(z)  *7(z)]  — >  [p{z)  q(z)]T~l  to  further  modify  our  factorization  procedure.  For 
instance,  we  can  use  the  transformation 

1 

~j. 

to  obtain  the  expression 


B(z  w)  =  j  fr(2)faV))*  -  a(z)|/>V)r 
l1  zVA*  M* 


(20) 


where  a(z)Mz)  are  arbitrary  complex  polynomials.  Finally,  we  can  transform  the 
two-term  factorization  recursions  into  a  three-term  form  and  examine  the  complexity 
and  numerical  robustness  of  the  resulting  procedures. 


When  we  make  the  specific  choice  q(z)  =  p#(z)  in  (19)  the  Bezoutian  becomes 
Hermitian.  In  that  case,  it  is  known  that  the  inertia  of  B  serves  to  locate  the  zeros  of 
the  complex  polynomials  p(z)  with  respect  to  the  curve  Q0.  We  have  a  new  simple 
proof  of  that  result;  moreover,  our  previously  mentioned  fast  factorization  procedures. 


both  in  two-term  and  in  three-term  form,  can  efficiently  establish  the  inertia  of  B.  We 
have  gained  some  insight  into  the  problem  of  singularity  (i.e.,  singular  leading  minors 
in  B)  and  shown  how  to  avoid  it  in  three-term  recursions.  We  intend  to  apply  this 
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concept  to  study  the  occurrence  of  the  singularities  in  two-term  recursions  and  to 
devise  a  simple  cure  to  this  problem. 

Symmetric  polynomials  play  a  central  role  in  the  theory  of  Bezoutians.  These  are 
polynomials  for  which  p*{z)  =  p(z).  If  we  restrict  a(z)  and  b(z)  in  (20)  to  be 
symmetric  the  Bezoutian  becomes  Hermitian,  and  consequently  the  computational 
requirements  of  its  factorization  procedure  reduce  by  a  factor  of  2.  Thus  the  gcd  of 
two  symmetric  polynomials  can  be  computed  with  half  the  number  of  computations 
required  for  arbitrary  complex  polynomials.  In  particular,  if  we  choose  Jd  =  JR  in 
(20),  the  polynomials  a(z),  b(z)  must  have  real  coefficients  and  the  corresponding 
factorization  procedure  coincides  with  the  partial  realization  algorithm  of  Kalman.  We 
intend  to  exploit  this  observation  to  examine  in  detail  the  possibility  of  constructing 
computationally-improved  alternatives  to  the  known  partial  realization  algorithm. 

Another  fascinating  observation  relates  Bezoutians  to  measures  defined  in  circles. 
We  have  shown  that  the  inverse  of  a  positive  definite  Bezoutian  is  the  moment  matrix 
of  a  positive  measure  defined  on  the  same  circle  as  the  Bezoutian.  This  observation 
provides  a  key  to  the  extension  of  the  notion  of  Bezoutians  to  curves  other  than 
circles,  which  we  intend  to  study  in  the  future. 

QR  Factorization 

The  factorization  of  a  matrix  into  a  product  QR  where  Q  is  an  orthogonal 
matrix  and  R  is  upper  triangular  is  a  key  step  in  the  eigenanalysis  of  this  matrix.  It 
is  also  instrumental  in  the  solution  of  linear  systems  of  equations  involving  matrices 
that  are  not  strongly  regular.  Recently  Cybenko  (1985)  has  proposed  a  method  for 
computing  the  singular  value  decomposition  of  a  matrix  via  QR  factorization. 


QR  factorization  of  a  matrix  A  is  closely  connected  with  the  triangular 
factorization  of  A* A  since 

A*A  =  R*Q*QR  =  R*R 

which  proves  that  R*  is  the  (unique)  lower-triangular  factor  of  A*A.  Thus  QR 
factorization  can  be  efficiently  carried  out  if  A*A  has  a  displacement  structure.  We 
have  shown,  in  fact,  that  if 

rank(A  -  ZAZ*)  =  a 

then 

rank(A*A  -  ZA*AZ*)  <  2a  +  1 

so  that  the  displacement  structure  for  A  is  inherited  by  the  product  A*A  (Chun, 
Kailath  and  Lev-Ari,  (1986)).  Moreover,  we  have  shown  how  to  construct  a  generator 
of  A*A  when  a  generator  for  A  is  known.  Once  as  generator  of  A*A  has  been 
computed  the  QR  factorization  of  A  is  obtained  in  0(an2)  operations  where  a  is 
the  displacement  rank  of  A. 

Our  previous  work  in  this  area  has  focused  on  the  Toplitz-oriented  notion  of 
displacement,  i.e.,  on  the  displacement  function  d(z,w)  =  1  -  zw*.  This  enabled  us  to 
derive  procedures  for  fast  QR  factorization  of  Toeplitz  and  close  to  Toeplitz  matrices. 
We  intend  to  extend  the  same  ideas  to  other  displacement  functions  in  order  to 
broaden  the  scope  of  applicability  of  our  fast  QR  factorization  procedures,  e.g.,  to 
Hankel  and  Vandermonde  matrices. 

In  another  direction  we  intend  to  examine  the  applicability  of  equivalence 
transformations  and  three-term  recursions  to  further  reduce  the  computational 


-17- 


complexity  of  our  QR  factorization  procedure. 

Connection  to  Inverse  Scattering  Theory 

Connections  between  scattering  theory  and  the  displacement  structure  of  covariance 
matrices  was  a  topic  that  received  much  attention  during  the  past  few  years.  It  was 
discovered  that  there  are  natural  mappings  between  transmission-line  structures,  and 
other  wave-propagation  models,  and  the  structure  of  fast  algorithms  for  factoring  or 
inverting  covariance  matrices  with  displacement  structures.  These  results  are  described 
in  papers  by  Kailath,  Bruckstein  and  Morgan  (1986)  on  fast  factorization  via 
transmission-line  models  and  Kailath  and  Lev-Ari  (1985)  on  mappings  between 
covariances  and  physical  systems.  It  turned  out  as  a  result  of  this  research  that  the 
factorization  algorithms  are  in  fact  solving  inverse  scattering  problems,  problems  that 
require  the  recovery  of  layered,  one-dimensional,  scattering  medium  properties  from  its 
response  to  a  probing  input.  The  input-response  pairs  are  the  scattering  data  from 
which  the  parameters  of  the  layered  medium  have  to  be  determined.  It  turns  out  that 
the  most  straightforward  approach  to  inverse  scattering  problems  is  based  on  a  careful 
analysis  of  the  causal  wave-propagation,  combined  with  the  local  properties  of  the 
scattering  medium.  This  approach  led  to  the  development  of  a  unified  theory  of  inverse 
scattering,  based  on  difference,  or,  in  the  continuous  case,  on  differential  equations. 
Several  interesting  results  in  inverse  scattering  theory  are  discussed  in  the  papers  by 
Bruckstein,  Levy  and  Kailath  (1985),  Bruckstein  and  Kailath  (accepted  to  SIAM 
Review,  1986/7).  The  results  encompass  several  differential  algorithms  that  were 
discovered  by  various  researchers  working  in  different  fields  such  as,  geophysics, 


distributed  systems  and  transmission-line  synthesis,  speech  research  connected  to 
pressure-wave  propagation  in  acoustic  tubes,  mathematics  and  mathematical  physics. 

The  classical  theory  of  inverse  scattering,  which  starts  from  the  physical  problem 
of  determining  potentials  from  quantum  scattering  experiments,  was  however  based  on 
solving  nested  sets  of  integral  equations  (associated  to  the  names  of  Gelfand-Levitan, 
Marchenko,  Krein  and  Gopinath-Sondhi)  rather  than  propagating  differential 
algorithms.  The  connections  between  these  approaches  also  became  clear  during  this 
research,  and  led  to  the  realization  that  when  the  structure  of  the  matrix/integral 
equations  is  exploited  i.e.,  when  the  so-called  fast  algorithms  for  solving 
matrix/integral  equations  having  Toepliz,  Hankel  or  Toeplitz+Hankel  structures  are 
used,  we  obtain  difference/differential  methods  that  closely  resemble  the  direct 
differential  methods  that  exploit  the  structure  of  the  scattering  medium  directly.  The 
algorithms  are  similar,  however,  not  identical,  and  this  was  an  important  point  to  see. 
It  was  then  observed  that  the  fast  algorithms  derived  in  conjunction  with  integral 
equations-based  methods  for  inverse  scattering  also  exploit  implicitly  the  medium 
structure,  however  in  a  different  way:  while  the  differential  methods  use  “layer- 
peeling",  i.e.  they  identify  the  next  layer  of  the  medium  and  then  propagate  the 
signals  through  it  to  synthesize  scattering  data  for  the  medium  portion  starting  one 
layer  deeper,  the  fast  algorithms  for  integral  equations  use  the  same  scattering  data  and 
propagate  it  through  the  entire  portion  of  medium  that  is  already  recovered.  So,  the 
information  for  identifying  the  next  medium  layer  is  gotten  by  propagating  the  original 
scattering  data  through  the  already  identified  portion  of  the  scattering  medium  and 
when  the  next  medium  layer  is  identified  it  is  adjoined  to  the  already  known  medium 
section.  For  this  reason  we  call  the  fast  integral  equations-based  algorithms  “laser 
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adjoining"  algorithms.  The  above-described  alternatives  for  doing  inverse  scattering, 
i.e.  layer-peeling  and  layer-adjoining  turned  out  to  be  quite  general  processes  that  can 
be  applied  to  a  variety  of  problems.  In  fact  we  recognized  that  the  classical  problem  of 
partial  realization  theory  falls  very  nicely  in  this  scattering  framework,  and  the  above 
inversion  alternatives  readily  yield  a  unified  picture  of  the  algorithmic  alternatives  one 
has  in  solving  this  problem  (see  Bruckstein  and  Kailath,  accepted  ASSP  Magazine 
paper,  1986/7). 

Computationally,  the  layer-peeling  and  adjoining  algorithms  have  the  same 
complexity  counts  (0{N2))\  however  the  layer  adjoining  methods  require  the 
computation  of  inner-products  (to  propagate  the  original  scattering  data  through  the 
already  identified  layers).  An  inner  product  is  a  computational  bottleneck  in  parallel 
implementations  since  a  long  addition  requires  O(lngN)  time,  even  with  N  processors. 
The  layer  peeling  algorithms,  which  avoid  explicit  computations  of  inner  products  by 
propagating  the  scattering  data  through  each  identified  layer,  are  more  suitable  for 
parallel  implementations. 

Direction  Finding,  Signal  Resolution  and  Covariance  Structures 

Another  avenue  of  research  during  the  period  of  our  contract  was  the  use  of  covariance 
structures  in  processing  signals  received  by  an  array  of  detectors.  The  basic  results  in 
tins  direction  concentrated  first  on  applying  an  algorithm  of  R  Scmidt,  called  Multiple 
Signal  Characterization  or  MUSIC,  developed  in  the  context  of  direction  finding  with 
antenna  arrays,  to  spatio-temporal  spectral  analysis  (Wax,  Shan  and  Kailath,  1()K4)  and 
to  a  wealth  of  signal  resolution  problems  (Bruckstein,  Shan  and  Kaila'h.  1985.  and  the 
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thesis  of  M.  Wax).  Several  important  results  were  also  obtained  on  the  basic  direction 
finding  problem  (the  paper  Optimum  Localization  of  Multiple  Sources  in  Passive 
Arrays,  by  Wax  and  Kailath,  was  awarded  the  senior  paper  award  of  the  ASSP  Society 
of  the  IEEE),  on  dealing  with  coherent  sources,  often  arising  in  multipath  situations, 
see.  e.g.  Shan,  Wax  and  Kailath  (1985),  and  on  the  determination  of  number  of 
sources  by  information  theoretic  criteria  (Wax  and  Kailath,  1985). 


-21- 


AFOSR  SUPPORTED  PUBLICATIONS  -  1983  -  1986 
Published  Journal  Papers 

I.  Gohberg,  T.  Kailath  and  I.  Koltracht,  “Linear  Complexity  Algorithms  for 
Semiseparable  Matrices,”  to  appear  Journal  Integral  Equations  and  Operator 
Theory,  Vol.  8,  pp.  779-804,  December  1985. 

A.  M.  Bruckstein,  T.  J.  Shan  and  T.  Kailath,  "The  Resolution  of  Overlapping  Echoes," 
IEEE  Trans.  ASSP ,  Vol.  ASSP-33,  no.  6,  pp.  1357-1367,  December  1985. 

T.  Kailath  and  H.  Lev- An,  “On  Mappings  Between  Covariance  Matrices  and  Physical 
Systems,”  in  Contemporary  Mathematics,  ed.  B.  Datta,  Amer.  Math.  Socy.,  Vol.  47, 
pp.  241-252,  Providence,  R.I.,  1985. 

T.  Kailath  and  L.  Ljung,  “Explicit  Strict  Sense  State-Space  Realizations  of 
Nonstationary  Gaussian  Processes,"  Inter’ l.  J.  Control.  Vol.  42,  no.  5,  pp.  971-988, 
November  1985. 

S.  K.  Rao  and  T.  Kailath,  "VLSI  Arrays  for  Digital  Signal  Processing,  Pt.  I.  A  Model 
Identification  Approach  to  Digital  Filter  Realizations,"  IEEE  Trans.  Circuits  and 
Systems,  pp.  1105-1117,  Vol.  CAS-32,  no.  11,  November  1985. 

M.  Wax  and  T.  Kailath,  "Decentralized  Processing  in  Passive  Arrays,"  IEEE  Trans. 
ASSP,  Vol.  ASSP-33,  no.  4,  pp.  1123-1129,  October  1985. 

T.  J.  Shan,  M.  Wax  and  T.  Kailath,  “On  Spatial  Smoothing  for  Direction-of-Arrival 
Estimation  of  Coherent  Sources,"  IEEE  Trans.  ASSP,  Vol.  ASSP-33,  no.  4,  pp.  806- 
811,  August  1985. 

J.  M.  Cioffi  and  T.  Kailath,  “An  Efficient  RLS,  Data-Driven  Echo  Canceller  for  Fast 
Initialization  of  Full-Duplex  Transmission,”  IEEE  Trans.  Communications,  Vol. 
COM-33,  no.  7,  pp.  601-611,  July  1985. 

J.  M.  Cioffi  and  T.  Kailath,  “Windowed  Fast  Transversal  Filters  Adaptive  Algorithms 
with  Normalization,”  IEEE  Trans.  ASSP,  Vol.  ASSP-33,  no.  3,  pp.  607-625,  June 
1985.  Also,  IBM  Research  Laboratory  Tech.  Rept.  RJ4544,  San  Jose,  December  1984. 

A.  M.  Bruckstein  and  T.  Kailath,  “Recursive  Limited  Memory  Filtering  and  Scattering 
Theory,"  IEEE  Trans.  Inform.  Thy.,  Vol.  IT-31,  no.  3,  pp.  440-443,  May  1985. 

A.  M.  Bruckstein,  B.  C.  Levy  and  T.  Kailath,  “Differential  Methods  in  Inverse 
Scattering,"  SIAM  J.  Appl.  Math,  Vol.  45,  no.  2,  pp.  312-335,  April  1985. 

M.  Wax  and  T.  Kailath,  “Detection  of  Signals  by  Information  Theoretic  Criteria," 
IEEE  Trans,  on  ASSP,  Vol.  ASSP-33,  no.  2,  pp.  387-392,  April  1985. 


-22- 


T.  Kailath,  “Signal  Processing  in  the  VLSI  Era,"  in  Modern  Signal  Processing  and 
VLSI,  pp.  5-24,  ed.  by  S.  Y.  Kung,  H.  Whitehouse  and  T.  Kailath,  Prentice-Hall,  1985. 

J.  M.  Cioffi  and  T.  Kailath,  “An  Efficient  Exact-Least-Squares  Fractionally  Spaced 
Equalizer  Using  Intersymbol  Interpolation,”  IEEE  Trans.  Communications,  Vol  SAC- 
2,  no.  5,  pp.  743-756,  September  1984. 

S.  R.  Rao  and  T.  Kailath,  “Orthogonal  Digital  Filters  for  VLSI  Implementation,"  IEEE 
Trans.  Circuits  &  Systems,  Vol.  CAS-31,  no.  11,  pp.  933-945,  November  1984. 

M.  Wax,  T-J.  Shan  and  T.  Kailath,  “Spatio-Temporal  Spectral  Analysis  by 
Eigenstructure  Methods,"  IEEE  Trans.  ASSP,  Vol.  ASSP-32,  no.  4,  pp.  817-827, 
August  1984. 

T.  Kailath  and  M.  Wax,  “A  Note  on  the  Complementary  Model  of  Weinert  and 
Desai,"  IEEE  Trans.  Autom.  Contr.,  Vol.  AC-29,  no.6,  pp.  551-552,  June  1984. 

H.  Lev-Ari,  J.  Cioffi  and  T.  Kailath,  “Least-Squares  Adaptive-Lattice  and  Transversal 
Filters:  A  Unified  Geometric  Theoiy,"  IEEE  Trans,  on  Inform.  Thy.,  (special  issue), 
Vol.  IT-30,  pp.  222-236,  March  1984. 

J.  M.  Cioffi  and  T.  Kailath,  “Fast,  Recursive-Least-Squares  Transversal  Filters  for 
Adaptive  Filtering,"  IEEE  Trans.  ASSP,  Vol.  ASSP-32,  no.  2,  pp.  304-337,  April  1984. 

M.  Wax  and  T.  Kailath,  “Direct  Approach  to  the  Two-Filter  Smoothing  Formulas," 
Inter’l.  J.  Control,  Vol.  39,  no.  3,  pp.  517-522,  1984. 

H.  Lev-Ari  and  T.  Kailath,  “Lattice  Filter  Parametrization  and  Modeling  of 
Nonstationary  Processes,"  IEEE  Trans.  Inform.  Thy.,  Vol.  IT-30,  no.  1,  pp.  2-16, 
January  1984. 

B.  Egardt,  T.  Kailath  and  V.  U.  Reddy,  “High-Resolution  Spectral  Analysis  using 
Multi-Step  Adaptive  Prediction,"  Circuits,  Systems  and  Signal  Processing,  Vol.  2,  no.. 
4,  pp.  422-443,  December  1983. 

M.  Wax,  "Position-Location  from  Sensors  with  Position  Uncertainty,"  IEEE  Trans. 
AES,  Vol.  19,  no.  5,  pp.  658-602,  September  1983. 

M.  Wax  and  T.  Kailath,  “Optimum  Localization  of  Multiple  Sources  in  Passive 
Arrays,"  IEEE  Trans.  ASSP,  Vol.  ASSP-31,  no.  5,  pp.  1210-1218,  October  1983. 

M.  Wax  and  T.  Kailath,  “Efficient  Inversion  of  Doubly  Block  Toeplitz  Matrix,"  IEEE 
Trans.  ASSP,  Vol.  ASSP-31,  no.  5,  pp.  1218-1221,  October  1983. 

T.  Kailath,  L.  Ljung  and  M.  Morf,  "Recursive  Input-Output  and  State-Space  Solutions 
for  Continuous-Time  Linear  Estimation  Problems,"  IEEE  Trans.  Autom.  Contr.,  Vol. 
AC-28,  no.  9,  pp.  897-906,  September  1983. 


-23- 


\ 

E.  I.  Verriest  and  T.  Kailath,  “On  Generalized  Balanced  Realizations,"  IEEE  Trans,  on  ' 

Autom.  Contr.,  Vol.  AC--28,  no.  8,  pp.  833-844,  August  1983.  < 

I 

t 

I 

i 

Accepted  Papers  j 

t 

A.  M.  Bruckstein,  I.  Koltracht  and  T.  Kailath,  “Inverse  Scattering  with  Noisy  Data,"  ! 

SIAM  J.  on  Scientific  and  Statistical  Computing.  : 

A.  Paulraj  and  T.  Kailath,  “Eigenstructure  Methods  for  Direction  of  Arrival  Estimation 
in  the  Presence  of  Unknown  Noise  Fields,”  IEEE  Trans.  ASSP. 

I.  Gohberg,  T.  Kailath  and  I.  Koltracht,  “Efficient  Solution  of  Linear  Systems  of 
Equations  with  Recursive  Structure,”  Linear  Algebra  and  Its  Applications. 

T.  Kailath,  “A  Theorem  of  I.  Schur  and  Its  Impact  on  Modem  Signal  Processing,” 
special  issue,  Integral  Equations  and  Operator  Theory,  1986. 

H.  Lev-Ari  and  T.  Kailath,  “Triangular  Factorization  of  Structured  Hermitian 
Matrices,”  to  appear  in  Integral  Equations  and  Operator  Theory,  Special  Issue 
Dedicated  to  I.  Schur,  1986. 

I.  Gohberg,  T.  Kailath  and  I.  Koltracht,  “A  Note  on  Diagonal  Innovation  Matrices,” 

IEEE  Trans.  ASSP. 

A.  Paulraj  and  T.  Kailath,  “Direction  of  Arrival  Estimation  by  Eigenstructure, 

Methods  with  Unknown  Sensor  Gain  and  Phase,”  IEEE  ASSP,  to  appear. 

S.  Rao,  T.  K.  Citron  and  T.  Kailath,  “Mesh-Connected  Processor  Arrays  for  Transitive 
Clsoure  Problem,’  ’  24th  IEEE  Conference  on  Decision  and  Control,  invited  paper. 

A.  Bruckstein  and  T.  Kailath,  “Inverse  Scattering  for  Discrete  Transmission-Line 
Models,"  SIAM  Review. 

A.  Bruckstein  and  T.  Kailath,  “An  Inverse  Scattering  Framework  for  Several  Problems 
in  Signal  Processing,”  ASSP  Magazine. 

T.  Kailath  and  I.  Koltracht,  “Matrices  with  Block  Toeplitz  Inverses,”  Linear  Algebra 
and  Its  Applications. 

A.  Bruckstein  and  T.  Kailath,  “Some  Matrix  Factorization  Identities  for  Discrete 
Inverse  Scattering,"  Linear  Algebra  and  Its  Applications. 

T.  Kailath,  A.  Bruckstein  and  D.  Morgan,  “Fast  Matrix  Factorizations  via  Discrete 
Transmission  Lines,"  Linear  Algebra  and  Its  Applications. 


mumBmmmms  n\  m  *x  wm  y  v  w  »jj  w 


WTO 


VWTWTTTO  >5^P5W>  "jrWTW? 


-24- 

Published  Conference  Papers 

Y.  Bistritz,  H.  Lev-Ari  and  T.  Kailath,  “Immitance-Domain  Levinson  Algorithms,” 
ICASSP,  Tokyo,  Japan,  April  1986. 

H.  Lev-Ari,  ‘‘Continuous-Time  Discrete-Order  Lattice  Filters,”  ICASSP,  Tokyo,  Japan, 
1986. 

A.  M.  Bruckstein,  T.  J.  Shan  and  T.  Kailath,  ‘‘A  Time-Domain  Signal  Resolution 
Problem,”  ICASSP,  Tokyo,  Japan,  1986. 

T.  J.  Shan,  A.  M.  Bruckstein  and  T.  Kailath,  ‘‘Multiple  Signal  Resolution  with 
Uncertain  Signal  Subspace  -  A  Self-Cohering  Approach,”  19th  Asilomar  Conference 
on  Circuits,  Systems  and  Computers,  pp.  ,  Monterey,  CA,  November  6,  1985. 

T.  J.  Shan,  A.  M.  Bruckstein  and  T.  Kailath,  ‘‘Adaptive  Resolution  of  Overlapping 
Echoes,”  19th  Asilomar  Conference  on  Circuits,  Systems  and  Computers,  pp.  , 
Monterey,  CA,  November  6,  1985. 

T.  J.  Shan  and  T.  Kailath,  ‘‘Adaptive  Filtering  Algorithms  with  Automatic  Gain 
Control,”  19th  Asilomar  Conference  on  Circuits,  Systems  and  Computers,  pp.  , 
Monterey,  CA,  November  6,  1985. 

J.  M.  Cioffi  and  T.  Kailath,  ‘‘An  Efficient  RLS,  Data-Driven  Echo  Canceller  for  Fast 
Initialization  of  Full-Duplex  Transmission,”  ICC  1985,  Chicago,  ILL,  June  1985. 
IBM  Research  Laboratory  Tech.  Rept.  RJ  4598,  San  Jose,  CA,  February  1985. 

H.  Lev-Ari,  “Multidimensional  Maximum-Entropy  Covariance  Extensions,”  ICASSP 
'85,  pp.  816-819,  Tampa,  FL,  March  1985. 

H.  Lev-Ari,  “Orthogonality  of  Oblique  Projections  and  Lattice-Form  Models,” 
ICASSP  ’85,  pp.  1493-1496,  Tampa,  FL,  March  1985. 

A.  Paulraj,  T.  J.  Shan  and  T.  Kailath,  “Direction  of  Arrival  Estimation  for  Signals  in 
the  Presence  of  Unknown  Noise  Fields,”  International  Conf.  on  Computers,  Signal 
Processing,  Bangalore,  India,  December  1984. 

H.  V.  Jagadish,  T.  Kailath,  R.  G.  Mathews,  J.  A.  Newkirk,  “A  Systematic  Scheduling 
Notation  for  Digital  Design,”  IEEE  Workshop  on  Language  for  Automation,  New 
Orleans,  LA,  November,  1984. 

S.  K.  Rao  and  T.  Kailath,  “Digital  Filtering  in  VLSI,”  Proc.  Twenty-Second  Annual 
Allcrton  Conf.  on  Comm.,  Control  &  Computing,  pp.  1-10,  Oct.  1984. 

T.  Kailath  and  A.  M.  Bruckstein,  “Naimark  Dilations,  State-Space  Generators  and 
Transmission  Lines,”  9th  Annual  Inter' l.  Conf.  on  Operator  Thy.,  Timisoara.  Romania. 
June  4-14,  1984. 


-25- 


T.  Kailath,  A.  Bruckstein  and  D.  Morgan,  “Fast  Matrix  Factorization  via  Discrete 
Transmission  Lines,"  American  Math.  Soc.  Meeting,  Linear  Algebra  and  Its  Role  in 
Systems  Theory ,  July,  1984.  Abstract 

J.  M.  Cioffi  and  T.  Kailath,  “An  Efficient,  Recursive-Least  Squares,  Fractionally 
Spaced  Equalizer  using  Intersymbol  Interpolation,"  ICC'84 ,  Amsterdam,  Holland,  May 
14-17,  1984. 

T.  J.  Shan  and  T.  Kailath,  “New  Adaptive  Processor  for  Coherent  Signals  and 
Interference"  ICASSP ,  pp.  33.5.1-33.5.4,  San  Diego,  CA,  March  1984. 

M.  Wax  and  T.  Kailath,  “Determining  the  Number  of  Signals  by  Akaike's  Information 
Criterion,"  ICASSP,  pp.  6.3.1 -6.3.4,  San  Diego,  CA,  March  1984. 

M.  Wax  and  T.  Kailath,  “A  New  Approach  to  Decentralized  Array  Processing," 
ICASSP,  pp.  40.7.1-40.7.4,  San  Diego,  CA,  March  1984. 

S.  K.  Rao  and  T.  Kailath,  “Pipelined  Orthogonal  Digital  Lattice  Filters,"  ICASSP,  pp. 

1 1.10.1-11 .10.4,  San  Diego,  CA,  March  1984. 

11  Lev-Ari  and  T.  Kailath,  “Spectral  Analysis  of  Nonstationary  Processes."  I  ELL 
Inter' l .  Symp.  on  Inform.  Thy.,  St.  Jovite,  Quebec,  Canada,  Sept.  1983.  Abstract. 

T.  J.  Shan,  M.  Wax  and  T.  Kailath,  “Spatial  Smoothing  Approach  for  Location 
Estimation  of  Coherent  Sources,"  1 7th  Asilomar  Conference  on  Circuits,  Systems  and 
Computers,  Monterey,  CA,  Oct.  1983. 

T.  J.  Shan,  and  T.  Kailath,  “A  New  Adaptive  Antenna  System  for  Coherent  Signals 
and  Interference,"  17th  Asilomar  Conference  on  Circuits,  Systems  and  Computers, 
Monterey,  CA,  Oct.  1983. 

T.  Kailath,  “Estimation  and  Control  in  the  VLSI  Era,"  The  22nd  IELL  Conf.  on 
Decision  <4  Contr.,  San  Antonio,  TX,  Dec.  1983. 

A.  M.  Bruckstein  and  T.  Kailath,  “Modeling  Rate-Modulated  Selfexciting  Point 
Processes,”  Proc.  of  Systems,  Man  and  Cybernetics  Conference,  pp.  431-433,  Bombay 
&  New  Delhi,  India,  Dec.  31,  1983. 

M.  Wax,  T.  Kailath  and  R.  O.  Schmidt,  “Retrieving  the  Poles  from  the  Natural 
Response  by  Eigenstructurc  Method,"  The  22nd  ILLE  Conf.  on  Decision  and  Control, 
San  Antonio,  TX,  December  14-16,  1983. 

M.  Wax  and  T.  Kailath,  “Determining  the  Number  of  Signals  by  Information 
Theoretic  Criteria,"  ASSP  Spectrum  Estimation  Workshop  II,  Tampa,  FL,  November 
10-11,1983. 

T.  J.  Shan  and  T.  Kailath,  “Adaptive  Beamforming  for  Coherent  Signals  and 


Interference,"  ASSP  Spectrum  Estimation  Workshop  II,  Tampa,  FL,  November  10-11. 
1983. 


M.  Wax,  T-J.  Shan  and  T.  Kailath,  “Covariance  Eigenstructure  Approach  to  Detection 
and  Estimation  by  Passive  Arrays,”  Pt.  I:  Direction-of-Arrival  and  Frequency 
Estimation  of  Multiple  Narrowband  Sources,"  IEEE  International  Symp.  on  Inform 
I h\  Canada,  September  1983. 

M  Wax.  T-J.  Shan  and  T.  Kailath,  “Covariance  Eigenstructure  Approach  to  Detection 
and  Estimation  by  Passive  Arrays,"  Pt.  II:  Source  Location  and  Spectral  Density 
Estimation  of  Wideband  Sources,"  IEEE  International  Symp.  on  Inform.  Thy.,  Canada, 

September  1983. 

I  M.  Ciol'ti  and  T.  Kailath,  "Fast,  Fixed-Order,  Least-Squares  Algorithms  for  Adaptive 
Filtering.”  1 983  ICASSP  pp.  679-682,  Boston,  MA,  April  1983. 

M  Wax  and  T.  Kailath,  "Efficient  Inversion  of  Doubly  Block  Toeplitz  Matrix,"  1983 
ICASSP.  pp.  170-173,  April  1983,  Boston,  MA. 

M  Wax.  T-J.  Shan  and  T.  Kailath,  "Covariance  Eigenstructure  Approach  to  2-D 
Harmonic  Retrieval,"  1983  ICASSP.  891-894,  April  1983,  Boston,  MA. 

V  L  Reddy,  T-J.  Shan  and  T.  Kailath,  "Application  of  Modified  Least-Square 
Algorithm  to  Adaptive  Echo  Cancellation,”  1983  ICASSP,  pp.  53-56,  April  1983, 

Boston,  MA 


Papers  l  rider  Rexiew 

V.  Ephraim,  H  Ixtv-Ari  and  R  M.  Gray,  “Asymptotic  Minimum  Discrimination 
Inl«>rmation  Measure  for  Asymptotically  Weakly  Stationary  Processes,”  IEEE  Trans. 

Inform.  Thy. 

T.  J  Shan,  A.  Paulraj  and  T.  Kailath,  “On  Smoothed  Rank  Profile  Tests  in 
Eigenstructure  Approach  to  Directions-of- Arrival  Estimation."  submitted  IEEE  Trans. 

ASSP. 

A.  Paulraj  and  T.  Kailath,  "On  Beamforming  in  Presence  of  Multipath,”  submitted 
II  I  A  Trans  Ant  atnl  Prop.,"  Jul\  1983 

A  M  llrm  kstein.  7  ./  Shan  and  T  Kailath.  "A  Time-Domain  Signal  Resolution 

Problem.' '  submitted  ICASSP  8ft,  Tokyo.  Japan. 

S.  Rao.  T.  K  Citron  and  T  Kailath,  "Mesh-Connected  Processor  Arrays  for  Transitive 
Clsoure  Problem,"  Journal  ACM 

S.  K.  Rao.  II  V.  Jacadish  and  T.  Kailath,  "Analysis  of  Iterative  Algorithms  for 


-27- 


Multi-Processor  Implementations,”  submitted  IEEE  Trans.  Circuits  and  Systems. 

H.  V.  Jagadish,  S.  K.  Rao  and  T.  Kailath,  “Multi-Processor  Architectures  for  Iterative 
Algorithms,”  submitted  Proc.  IEEE. 

H.  V.  Jagadish  and  T.  Kailath,  “A  Family  of  New  Efficient  Arrays  for  Matrix 
Multiplication,”  submitted  IEEE  Trans.  Computers. 

I.  Gohberg,  T.  Kailath  and  I.  Koltracht,  “Linear  Complexity  Parallel  Algorithm  for 
Discrete-Time  Wiener  Filters  with  Optimum  Lag,”  submitted  IEEE  Trans  ASSP. 

M.  Wax  and  T.  Kailath,  “Novel  Eigenstructure  Methods  for  Parameter  Estimation  of 
Superimposed  Signals,”  submitted  IEEE  Trans.  ASSP. 

M.  Wax  and  T.  Kailath,  “Simultaneous  Detection  and  Estimation  of  Superimposed 
Signals,”  submitted  IEEE  Trans.  IT. 


